Skip to content

Split out Linux CUDA Python package builds into separate stages#27490

Merged
edgchen1 merged 13 commits intomainfrom
edgchen1/py_packaging_split_cuda_linux_builds
Mar 2, 2026
Merged

Split out Linux CUDA Python package builds into separate stages#27490
edgchen1 merged 13 commits intomainfrom
edgchen1/py_packaging_split_cuda_linux_builds

Conversation

@edgchen1
Copy link
Contributor

Description

Split out Linux CUDA Python package builds into separate stages.

Motivation and Context

Reduce overall packaging pipeline time by running Python version builds in separate stages, allowing them to run in parallel.

Example build: https://aiinfra.visualstudio.com/Lotus/_build/results?buildId=1102253&view=results
Reduced time from ~3h30m to 1h38m.

Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Splits the Linux CUDA Python wheel build into one stage per Python version to enable parallel execution and reduce end-to-end packaging time, while reintroducing a single combined wheel artifact for downstream stages.

Changes:

  • Parameterized the Linux GPU wheel stage to build a single Python version per stage and optionally publish build intermediates.
  • Updated the GPU packaging stage to fan out Linux builds across Python versions and added a merge stage to produce a combined onnxruntime_gpu artifact.

Reviewed changes

Copilot reviewed 2 out of 2 changed files in this pull request and generated 3 comments.

File Description
tools/ci_build/github/azure-pipelines/stages/py-linux-gpu-stage.yml Adds per-Python build parameters, optional intermediates publishing, and publishes per-version wheel artifacts.
tools/ci_build/github/azure-pipelines/stages/py-gpu-packaging-stage.yml Introduces a Linux per-version stage fan-out and a merge stage to combine wheel artifacts for consumers.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

eserscor
eserscor previously approved these changes Mar 2, 2026
@edgchen1 edgchen1 requested review from Copilot and eserscor March 2, 2026 19:31
Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 3 out of 3 changed files in this pull request and generated 3 comments.


💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

@edgchen1 edgchen1 enabled auto-merge (squash) March 2, 2026 21:12
@edgchen1 edgchen1 merged commit 1acddf2 into main Mar 2, 2026
97 of 101 checks passed
@edgchen1 edgchen1 deleted the edgchen1/py_packaging_split_cuda_linux_builds branch March 2, 2026 22:28
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants